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ABSTRACT:  A key  step  in  Howden's  method  [5]  for  algebraic  program  testing 
requires  checking  the  algebraic  identity  of  multinomials.  Howden's  solution 
requires  evaluations  in  at  least  2™  points  for  m-ary  multinomials.  This 
note  presents  a probabilistic  solution  which  achieves  small  probability  of 


error  on  30  points. 


1.' 


Until  very  recently,  research  in  software  reliability  has  divided  quite 
neatly  into  two  — usually  warring  — camps;  methodologies  with  a mathematical 
basis  and  methodologies  without  such  a basis.  In  the  former  view,  "reliability" 
is  identified  with  "correctness"  and  the  principle  tool  has  been  formal  and 
informal  verification  [1].  In  the  latter  view,  "reliability"  is  taken  to  mean 
the  ability  to  meet  overall  functional  goals  to  within  some  predefined  limits 
[2,3],  We  Iiave  argued  in  [4]  that  the  latter  view  holds  a great  deal  of  promise 
for  further  development  at  both  the  practical  and  analytical  levels.  Howdon  [5] 
proposes  a first  step  in  this  direction  by  describing  a method  for  "testing"  a 
certain  restricted  class  of  programs  whose  behavior  can  — in  a sense  Howden 
makes  precise  — be  algebraicized . In  this  way,  "testing"  a program  is  reduced 
to  an  equivalence  test,  the  major  components  of  which  become 

(i)  a combinatorial  identification  of  "equivalent"  structures; 


(ii)  an  algebraic  test 


fl  = f2  . 


where  f^,  i = 1,  2 is  a multivariable  polynomial  (multinomial)  of  degree 

specified  by  the  program  being  considered. 

In  arriving  at  a method  for  exact  solution  of  (11),  Howdon  derives  an  algorithm 

which  requires  evaluation  of  multinomials  f (x, , ...  , x ) of  maximal  degree  d at 

I fn 

0(d  + 1)"*  points.  For  large  values  of  m (a  typical  case  for  realistic  examples), 
this  method  becomes  prohibitively  expensive. 

Since,  however,  a test  for  reliability  rather  than  a certification  of  correctness 
is  desired,  a natural  question  is  whether  or  not  Howden's  method  can  be  Improved  by 


settling  for  less  than  an  exact  solution  to  (11). 


Wc  arc*  Inspired  by  Rabin  [6]  and,  less  directly,  by  the  many  successes 

of  Erdos  and  Spencer  (7]  to  attempt  a probabilistic  solution  to  (il).  Using 

these  methods,  we  show  that  (ii)  can  be  tested  with  probability  of  error  C 

with  only  0(g(C))  evaluations  of  multinomials,  where  g is  a slowly  growing 

function  of  only  c.  In  particular,  30  or  so  evaluations  should  give  sufficiently 

small  probability  of  error  for  most  practical  situations.  The  remainder  of  this 

note  is  devoted  to  proving  this  result. 

Let  us  denote  by  P^gCm.d)  the  class  of  multinomials 

f (x-  , ...  , X ) ^ 0 
1 ra 

(over  some  arbitrary  but  fixed  integral  domain)  whose  degree  does  not  exceed  d > 0. 
We  define 

P(m,d,r)  = min  Prob  {l  < x,  < r,  f(x, , ...  , x ) + 0} 

~~~  — ~i  — -,1  ~m 

f e P^Q(m,d) 

We  think  of  P(m,d,r)  as  the  minimal  relative  frequency  with  which  witnesses 
to  the  non-nullity  of  a multinomial  of  the  appropriate  kind  can  occur  in  the 
choosen  Interval.  Notice,  in  particular,  that  since  a polynomial  of  degree  d has 
at  most  d roots  (ignoring  multiplicity),  the  largest  probability  of  finding  a 
root  must  be  at  least  the  probability  of  finding  a root  by  randomly  sampling  in 
the  Interval  1 £ £ r;  thus 

P(l,d,r)  > 1 - d/r  . 

Now,  consider  some 

f(Xi,  ...  , x^,y)  ^ 0 

of  degree  at  most  d.  But  there  are  then  multinomials  {g^}  j ^ 
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such  that 


f (x. , ...  , X , y ) 
1 m 


d 

y 

y ^ •••  » 

i - 0 


m 


Let  us  suppose  that  e P^^Cm.d).  Thus 


Prob 


{1  < X £ r,  f(x  , ...  , X ,y)  =f  0} 
-i  ~in 


> Prob  {g  (x  , ...  , X ) ^ 0 and  y is  not  a root} 

~ K -vi  •.m 


> P(m,d,r)(l  - d/r)  . 


Continuing  inductively,  we  obtain 


P(m,d,r)  > (1  - d/r)" 


(1) 


But 


lim  (1  - d/r)"*  = lim 


m -►  “> 


1 + 


-dm 

r 


-dm 

r 


(2) 


Combining  (1)  and  (2),  we  have  for  large  m,  r = dm. 


P(m,d,dm)  £ e 

Thus,  with  t evaluations  of  f for  Independent  choices  of  points  from  the  m-cube 
with  sides  r * dm,  the  probability  of  missing  a witness  to  the  non-nullity  of 


f(x, , ...,  X ) is  at  most 
1 m 


(1  - e ) . 
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Table  1 shows  the  probable  error  in  testing  f = 0 by  t evaluations  of 
f at  randomly  chosen  points  for  some  typical  values  of  d,m,r,t. 


[1  - PCm.d.r)]" 

dm 

B 

t=10 

t=20 

t=30 

t=50 

t=100 

10 

10 

1.0  X lo"2 

1.0  X 10“^ 

1.0  X iQ-® 

1.1  X lo" 

10 

-20 

1.2  X 10 

20 

10 

0.23 

5.5  X io”2 

1.3  X 10-2 

7.0  X 10“ 

A 

A. 8 X io‘2 

50 

10 

0.93 

0.87 

0.82 

0.71 

0.51 

CM 

O 

10 

1.0 

1.0 

1.0 

1.0 

1.0 

10 

10^ 

6.0  X lO"^ 

<10-20 

<10-20 

<10-20 

<10-20 

20 

10^ 

3.9  X lO"® 

1.5  X 10-^^ 

<10-20 

<10-20 

<10-20 

50 

10^ 

8.9  X lO"^ 

7.9  X 10-^ 

-13 

7.0  X 10  ^ 

<10-20 

<10-20 

10^ 

102 

1.0 

1.0 

1.0 

1.0 

1.0 

10 

10^ 

<10-20 

<10-20 

<10-20 

<10-20 

<10-20 

20 

10^ 

9.3  X lO"^® 

<10-20 

<10-20 

<10-20 

<10-20 

50 

10^ 

7.6  X lO"^^ 

<10-20 

<10-20 

<10-20 

<10-20 

Table 

1 . Probable 

Error  in  Testing 

^ (^1 > • • • 9 — 

1 m 

0 

(degree  £ 

d)  by  t random 

evaluations  in  {1, 

...  , r} 

Notice  that  for  dm  = r,  t * 30,  this  is  already  < 10~^. 
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